Enabling workers to swap between mobile devices

ABSTRACT

A method for identifying a second device by a first device for establishing a communication between the first device and the second device is described here. The method includes receiving, by a processor of a first device, a voice command from a worker in a workplace. In an example, the method comprises pausing, by the processor, a workflow operation executing on the first device. The method further comprises performing, by the processor, a voice recognition to analyze the voice command of the worker. The method includes activating, by the processor, a communication module of the first device based on the voice recognition, to identify a second device in proximity to the first device. The method includes terminating, by the processor, a connection between the first device and the wearable electronic device. Thus, terminating, by the processor, a second connection of the first device with the second device.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.17/192,579, filed Mar. 4, 2021, the contents of which are incorporatedherein by reference in their entirety.

TECHNOLOGICAL FIELD

Example embodiments described herein relate generally to systems,methods, and apparatuses to facilitate swapping between a plurality ofmobile devices.

BACKGROUND

In modern production environments and warehouses, it is increasinglydesirable for human operators to be able to change devices in case abattery of a mobile device depletes. This typically entails the use ofportable electronic voice-processing devices which can detect humanspeech, interpret the speech, and process the speech to recognize words,to control nearby electronic devices for swapping.

SUMMARY

The following presents a simplified summary to provide a basicunderstanding of some aspects of embodiments described herein. Thissummary is not an extensive overview and is intended to neither identifykey or critical elements nor delineate the scope of such elements. Itspurpose is to present some concepts of the described features in asimplified form as a prelude to the more detailed description that ispresented later.

A first device is described in accordance with some example embodiments.The first device includes a memory to store computer-executableinstructions and a processor in communication with a server, theprocessor performs operations in response to executing thecomputer-executable instructions. The operations can include receiving avoice command from a worker in a workplace. In this regard, the voicecommand is indicative of a battery level of the first device. Further,the operations can include pausing a workflow operation executing on thefirst device. Furthermore, the operations can include performing via aspeech recognizer of the first device, a voice recognition to analyzethe voice command of the worker. Furthermore, the operations can includeactivating based on the voice recognition, a communication module of thefirst device to identify a second device in proximity to the firstdevice. Further, the operations can include terminating a connectionbetween the first device and the wearable electronic device.Furthermore, the operations can include transferring information fromthe first device to the second device.

A system is described in accordance with another example embodiments.The system includes a server communicatively coupled to one or moredevices, the server comprises a processor that is configured to performthe steps. The processor is configured to determine a first batterylevel of a first device among the one or more devices. The processorthen generates a notification to the first device indicating that thefirst battery level is below a threshold value. Further, the processoris configured to pause a workflow operation executing on the firstdevice. Furthermore, the processor then identifies a second device amongthe one or more devices having a second battery level above thethreshold value. The processor of the server then directs the identifiedsecond device to resume the workflow operation from a step where theworkflow operation was paused.

According to some example embodiments, the method includes receiving, bya processor of a first device, a voice command from a worker in aworkplace. The voice command is indicative of a battery level of thefirst device. Further, the method includes pausing, by the processor, aworkflow operation executing on the first device. Furthermore, themethod includes performing, by the processor, a voice recognition toanalyze the voice command of the worker. Further, the method includesactivating, by the processor, a communication module of the first devicebased on the voice recognition, to identify a second device in proximityto the first device. Furthermore, the method includes terminating, bythe processor, a connection between the first device and the wearableelectronic device. The method further includes transferring, by theprocessor, information from the first device to the second device.

The above summary is provided merely for purposes of summarizing someexample embodiments to provide a basic understanding of some aspects ofthe disclosure. Accordingly, it will be appreciated that theabove-described embodiments are merely examples and should not beconstrued to narrow the scope or spirit of the disclosure in any way. Itwill be appreciated that the scope of the disclosure encompasses manypotential embodiments in addition to those here summarized, some ofwhich will be further described below.

BRIEF DESCRIPTION OF THE DRAWINGS

The description of the illustrative embodiments can be read inconjunction with the accompanying figures. It will be appreciated thatfor simplicity and clarity of illustration, elements illustrated in thefigures have not necessarily been drawn to scale. For example, thedimensions of some of the elements are exaggerated relative to otherelements. Embodiments incorporating teachings of the present disclosureare shown and described with respect to the figures presented herein, inwhich:

FIG. 1 illustrates a schematic of a workflow performance systemaccording to an example embodiment.

FIG. 2 illustrates an exemplary voice-controlled apparatus used forperforming a workflow operation, according to an example embodiment.

FIG. 3 illustrates an exemplary user device according to an exampleembodiment.

FIG. 4 illustrates a schematic block diagram of a workflow performancesystem according to an example embodiment.

FIG. 5 illustrates a block diagram of the voice-controlled apparatusused for performing a workflow operation, in accordance with an exampleembodiment.

FIG. 6 illustrates an example scenario depicting a communication anddata exchange between a user device and another device positioned in acharging station, in accordance with an example embodiment.

FIG. 7 shows a flowchart illustrating a method of utilizing voice-driventechnology according to an example embodiment.

FIGS. 8-9 illustrate a flow diagram representing a method of identifyinga second device by a first device for establishing a communicationbetween the first device and the second device so as to facilitateswapping between the first device and the second device, in accordancewith another example embodiment described herein.

FIG. 10 illustrates an example scenario depicting swapping between afirst electronic device (without screen) and a second electronic device(without screen), in accordance with an example embodiment.

FIG. 11 illustrates an example scenario depicting swapping between afirst electronic device (with screen) and a second electronic device(with screen), in accordance with an example embodiment.

FIG. 12 illustrates a schematic view of an example electronic deviceused for performing a workflow operation, in accordance with an exampleembodiment.

FIG. 13 illustrates a schematic view of another example electronicdevice used for performing a workflow operation, in accordance withanother example embodiment.

DETAILED DESCRIPTION

Some embodiments of the present disclosure will now be described morefully hereinafter with reference to the accompanying drawings, in whichsome, but not all embodiments of the disclosure are shown. Indeed, thedisclosure may be embodied in many different forms and should not beconstrued as limited to the embodiments set forth herein; rather, theseembodiments are provided so that this disclosure will satisfy applicablelegal requirements. The terms “or” and “optionally” are used herein inboth the alternative and conjunctive sense, unless otherwise indicated.The terms “illustrative” and “exemplary” are used to be examples with noindication of quality level. Like numbers refer to like elementsthroughout.

The components illustrated in the figures represent components that mayor may not be present in various embodiments of the disclosure describedherein such that embodiments may comprise fewer or more components thanthose shown in the figures while not departing from the scope of thedisclosure.

Generally, in a work environment, it can be desirable for a worker toswap from one device to another device in case a battery of a devicein-use gets depleted. In an example embodiment, the worker might beperforming a workflow operation utilizing a wearable electronic deviceand a mobile device (for example, a handheld computer or a portablecomputer). The on-going workflow execution might be paused when abattery of the mobile device in-use gets drained. The worker performingthe workflow operation with the mobile device can issue a voice commandindicating that the battery of the mobile device is low. After the voicecommand is recognized, a communication module (for example, an NFCmodule) of the mobile device can be activated to identify another mobiledevice in proximity. A connection between the wearable electronic deviceand the mobile device can be terminated so as to establish a newconnection between the another mobile device and the wearable electronicdevice. The another mobile device once identified can be swapped withthe mobile device to resume the workflow operation. Information from themobile device in-use can be transferred to the another mobile device.Then, the workflow execution can be resumed by the identified anothermobile device from the point where it was paused.

In an alternate example embodiment, it can be desirable to notify theworker that the battery of the mobile device in-use is draining. Inwarehouses, a management system can monitor battery levels of all thedevices being used by the workers for performing the workflowoperations. The management system can determine if a battery of a deviceis low and there is a need to either change the device or charge thebattery of the device. The workflow operation being performed in thedevice can be paused. The management system can send notification to anoperator of the device in-use to indicate that the battery level of thedevice is about drain. A connection between the device in-use and thewearable electronic device can be terminated so as to establish a newconnection between the another device and the wearable electronicdevice. Further, the management can identify another device which may befully charged to replace the device that is draining. In an embodiment,the nother device selected for swapping can be identified in response tothe nother device generating an alert, for example, displaying a name ofthe worker handling the draining device. The management system can alsoprepare the another device for replacement by transferring informationto the another device.

The worker who may be working in demanding environment, might need toconcentrate on an allocated task without any interruption. The workermight be using multiple devices to perform the allocated task, forexample, a mobile device connected with peripheral devices such asheadsets, scanners, pocket printers, PDTs, terminal devices, etc. Whenthe worker determines that a battery of the mobile device is about todeplete soon, he might be required to swap the mobile device with a newfully charged device. However, a process of swapping between the devicecan be time consuming and inefficient. The worker might need to sign offfrom the device in-use and then sign-in to a new mobile device. Theworker might need to download all the relevant information, tasks,templates in the new device so as to resume the workflow operations.Further, the worker may have to re-connect all the peripheral deviceswith the new mobile device. Therefore, the present disclosure canprovide an efficient method of identifying a near-by target device (forexample, via a Bluetooth low energy protocol) to swap with the drainingdevice based on voice commands issued by the worker or based onmonitoring the battery level of the device by a server. The targetdevice can then be provided with the information of the draining deviceso that the identified target device can establish connections with theperipheral devices and can resume the workflow execution. The workermight not need to manually connect each of the peripheral devices withthe mobile device. Also, the worker might not need to sign-in in thetarget device manually. In this way, the overall efficiency of theworker can be improved and thereby, reducing the time of connection anddisconnection of peripheral devices. Details of various exampleembodiments for generating the alerts, are described in reference toFIGS. 1-13 hereinafter.

The term “electronic device” used hereinafter refers to any or all of,handheld devices, mobile phones, wearable devices, personal dataassistants (PDAs), tablet computers, smart books, palm-top computers,barcode readers, scanners, indicia readers, imagers, Radio-frequencyidentification (RFID readers or interrogators), vehicle-mountedcomputers, wearable barcode scanners, wearable indicia readers, a pointof sale (POS) terminal, headset devices, programmable logic controllers(PLCs), programmable automation controllers (PACs), industrialcomputers, laptop computers, desktop computers, personal computers, andsimilar electronic devices equipped with at least a processor configuredto perform the various operations described herein.

The various embodiments are described herein using the term “computingplatform” or “master device” used interchangeably for the purpose ofbrevity. The term “computing platform” can be used herein to refer toany computing device or a distributed network of computing devicecapable of functioning as a server, such as a master exchange server,web server, mail server, document server, or any other type of server. Acomputing platform may be a dedicated computing device or a computingdevice including a server module (e.g., running an application which maycause the computing device to operate as a server). A server module(e.g., server application) may be a full function server module, or alight or secondary server module (e.g., light or secondary serverapplication) that is configured to provide synchronization servicesamong the dynamic databases on computing devices. A light server orsecondary server may be a slimmed-down version of server typefunctionality that can be implemented on a computing device, such as asmartphone, thereby enabling it to function as an Internet server (e.g.,an enterprise e-mail server) only to the extent necessary to provide thefunctionality described herein.

In some example embodiments, the computing platform may correspond toany of, an industrial computer, a cloud computing-based platform, anexternal computer, a standalone computing device, and/or the like. Insome example embodiments, the master device, or the computing platform,can also refer to any of the electronic devices, as described herein. Insome example embodiments, the computing platform may include an accesspoint or a gateway device that can be capable of communicating directlywith one or more electronic devices and can also be capable ofcommunicating (either directly or alternatively indirectly via acommunication network such as the Internet) with a network establishmentservice (e.g. Internet service provider). In some example embodiments,the computing platform can refer to a server system that can manage thedeployment of one or more electronic devices throughout a physicalenvironment. In some example embodiments, the computing platform mayrefer to a network establishment service including distributed systemswhere multiple operations are performed by utilizing multiple computingresources deployed over a network and/or a cloud-based platform orcloud-based services, such as any of a software-based service (SaaS),infrastructure-based service (IaaS) or platform-based service (PaaS)and/or like.

Referring now to FIG. 1 , illustrated is a workflow performance system100 including an example network architecture for a system, which mayinclude one or more devices and sub-systems that can be configured toimplement some embodiments discussed herein. For example, workflowperformance system 100 can include server 105, which can include, forexample, the circuitry disclosed in FIGS. 2-4 , a server, or database,among other things (not shown). The server 105 may include any suitablenetwork server and/or other type of processing device. In someembodiments, the server 105 may receive requests and transmitinformation or indications regarding such requests to operator devices103-103N and/or one or more supervisor devices 106. The operator devices103-103N referred herein can correspond to electronic devices that maybe used by operators (e.g. workers) in a work environment whileperforming various tasks. Further, the supervisor devices 106 referredherein can correspond to electronic devices used by a supervisor of theoperators in the work environment. In an example, the work environmentcan correspond to a warehouse or inventory and the supervisor can be awarehouse manager.

In some example embodiments, the server 105 can communicate with one ormore operator devices 103-103N and/or one or more supervisor devices 106via network 120. In this regard, network 120 may include any wired orwireless communication network including, for example, a wired orwireless local area network (LAN), personal area network (PAN),metropolitan area network (MAN), wide area network (WAN), or the like,as well as any hardware, software and/or firmware required to implementit (such as, e.g., network routers, etc.). For example, network 120 mayinclude a cellular telephone, an 802.11, 802.16, 802.20, and/or WiMaxnetwork. In some embodiments, Bluetooth may be used to communicatebetween devices. Further, the network 120 may include a public network,such as the Internet, a private network, such as an intranet, orcombinations thereof, and may utilize a variety of networking protocolsnow available or later developed including, but not limited to TCP/IPbased networking protocols.

In some example embodiments, the network 120 can include, but are notlimited to, a Wireless Fidelity (Wi-Fi) network, a Piconet, a PersonalArea Network (PAN), Zigbee, and a Scatter net. In some examples, thenetwork 120 can correspond to a short-range wireless network throughwhich the operator devices 103-103N can communicate with each otherusing one or more communication protocols such as, but are not limitedto, Wi-Fi, Bluetooth, Bluetooth low energy (BLE), Zigbee, Ultrasonicfrequency based network, and Z-Wave. In some examples, the network 120can correspond to a network in which the plurality of electronic devicescan communicate with each other using other various wired and wirelesscommunication protocols such as Transmission Control Protocol andInternet Protocol (TCP/IP), User Datagram Protocol (UDP), and 2G, 3G, or4G communication protocols. In some examples, the network 120 cancorrespond to any communication network such as, but not limited to,LORA, cellular (NB IoT, LTE-M, Leaky Feeder Coax, etc.)

In some example embodiments, the operator devices 103-103N, supervisordevice 106, and/or server 105 may each be implemented as a computingdevice, such as a personal computer and/or other networked device, suchas a cellular phone, tablet computer, mobile device, point of saleterminal, inventory management terminal etc. The depiction in FIG. 1 of“N” members is merely for illustration purposes. Further, while only onesupervisor device 106 is illustrated in FIG. 1 , in some embodiments,multiple or a plurality of supervisor device 106 may be connected in thesystem. Furthermore, any number of users, operator devices and/orsupervisor devices may be included in the workflow performance system100. In one embodiment, the operator devices 103-103N and/or supervisordevices 106 may be configured to display an interface on a display ofthe respective device for viewing, creating, editing, and/or otherwiseinteracting with the server. According to some embodiments, the server105 may be configured to display the interface on a display of theserver 105 for viewing, creating, editing, and/or otherwise interactingwith information on the server 105. In some embodiments, an interface ofoperator devices 103-103N and/or supervisor device 106 may be differentfrom an interface of a server 105. Various components of the presentsystem may be performed on one or more of the operator devices 103-103N,supervisor device 106, or server 105. Workflow performance system 100may also include additional client devices and/or servers, among otherthings.

According to some example embodiments, the operator devices 103-103N caninclude, for example, but not limited to, an electronic device 102 (e.g.a mobile device, a PDA etc.) and a voice-controlled apparatus 101 (e.g.a headset device, a wearable head mounting device, a wearable electronicdevice etc.). In this regard, an operator in the work environment canuse the electronic device 102 and/or the voice-controlled apparatus 101to perform one or more operations in the work environment. For instance,in some example embodiments, the operator devices 103-103N can be usedby operators to execute a workflow operation that can include one ormore tasks. In this regard, in some examples, the workflow operation caninclude a sequence or series of steps to be performed by the operator.In some example embodiments, one or more steps of the workflow operationcan be provided in form of voice directed instructions or graphical userinterface (GUI) based instructions to the operators on the operatordevices 103-103N.

As an example, in a work environment (e.g. a warehouse, an industrialenvironment, a distribution center, etc.), an operator can use theelectronic device 102 that can be preconfigured with an application(e.g. a mobile application) to execute a workflow operation. Forinstance, in some examples, the operators can use these devices (i.e.the operator devices 103-103N, electronic devices, for example, 102) forautomatic identification and data capturing of information and toimprove productivity in the work environment. In some examples, theapplication can be used to execute various steps of the workflowoperation. According to some example embodiments, the application can beinstalled on at least one of the electronic device 102 and thevoice-controlled apparatus 101 and can be used to generate instructionsfor the operators at each step of the workflow operation. Theseinstructions can be provided on the electronic device 102 and/or thevoice-controlled apparatus 101.

According to some example embodiments, the voice-controlled apparatus101 can be used to provide instructions to the operators in form of‘voice prompts’ to perform various activities in the work environment.For instance, in an example, for a picking workflow operation, theoperators can be provided instructions in form of voice prompts on thevoice-controlled apparatus 101 for picking various items in aninventory. The voice prompts in such case may include instructions forthe operators, like, but not limited to, ‘reach to a location of theinventory’, ‘confirm a check-digit associated with the location’,‘identify an item from amongst several item’, ‘confirm a stock-keepingunit (SKU) associated with the item’, ‘pick the item’, ‘move to nextlocation’, and so on. Further, in some example embodiments, theelectronic device 102 can be configured to provide instructions to theoperators in visual form i.e. instructions that can be displayed on aGUI of the electronic device 102. Accordingly, the operators can performa step of the workflow operation based on instructions provided in thevoice prompt and/or visual prompt. Further, the electronic device 102and/or the voice-controlled apparatus 101 can be configured to receiveoperator's response to the instructions. For instance, as the operatorsperform the task, the operators can provide a ‘voice response’ and/or aGUI input based response on the voice-controlled apparatus 101 and/orthe electronic device 102, respectively.

Illustratively, the operator devices 103-103N can be communicativelycoupled over the network 120. Similarly, in accordance with some exampleembodiments, the electronic device 102 can be communicatively coupled tothe voice-controlled apparatus 101 via the network 120. As an example,the voice-controlled apparatus 101 can be communicatively coupled to theelectronic device 102 over a Bluetooth communication based network. Inthis regard, the electronic device 102 can exchange data and variouscommands with the voice-controlled apparatus 101 using the Bluetoothnetwork.

In some examples, voice-based instructions and visual-based instructionsof the task of the workflow can be provided simultaneously on thevoice-controlled apparatus 101 and the electronic device 102,respectively. In this regard, a state of execution of workflow on theelectronic device 102 and/or the voice-controlled apparatus 101 can besynchronized such that, either of a voice response and/or a GUI basedinput can be provided by the operator in response to the voice promptand/or visual instruction for a same step of workflow operation to causethe workflow operation to move to a next state on both thevoice-controlled apparatus 101 and the electronic device 102.

According to some example embodiments, the operator devices 103-103N canreceive a file including one or more workflows that are to be executedon the operator device 103-103N. In this regard, according to someexample embodiments, a workflow operation can be executed on theoperator devices 103-103N (e.g., the electronic device 102 and/or thevoice-controlled apparatus 101) based on exchange of messages betweenthe devices. In some example embodiments, the operator devices 103-103Ncan receive the file including the one or more workflows from the server105.

According to some example embodiments, the electronic device 102, thevoice-controlled apparatus 101, the operator devices 103-103N,supervisor device 106, and/or server 105 may include one or more inputdevices, including but not limited to a keyboard, a number pad, a mouse,a touch-sensitive display, a navigation key, a function key, amicrophone, a voice recognition component, any other mechanism capableof receiving an input from a user, or any combination thereof. Further,the operator devices 103-103N, supervisor device 106, and/or server 105may include one or more output devices, including but not limited to adisplay, a speaker, a haptic feedback mechanism, a printer, lights, anyother mechanism capable of presenting an output to a user, or anycombination thereof.

The operator devices 103-103N, supervisor device 106, and/or server 105may include components for monitoring and/or collecting informationregarding the user or external environment in which the component isplaced. For instance, the operator devices 103-103N, supervisor device106, and/or server 105 may include sensors, scanners, and/or othermonitoring components. In some embodiments, scanners may be used todetermine the presence of certain individuals or items. For example, insome embodiments, the components may include a scanner, such as anoptical scanner, RFID scanner, and/or other scanner configured to readhuman and/or machine readable indicia physically associated with anitem.

FIG. 2 illustrates an exemplary voice-controlled apparatus 200 accordingto an example embodiment. In the embodiment illustrated in FIG. 2 , thevoice-controlled apparatus 200 can correspond to a headset that caninclude a wireless enabled voice recognition device that utilizes ahands-free profile.

In accordance with some example embodiments, the headset may besubstantially similar to the headset disclosed in U.S. ProvisionalPatent Application No. 62/097,480 filed Dec. 29, 2014, U.S. ProvisionalPatent Application No. 62/101,568, filed Jan. 9, 2015, and U.S. patentapplication Ser. No. 14/918,969, and the disclosures therein are herebyincorporated by reference in their entireties.

In accordance with an example embodiment, as illustrated, thevoice-controlled apparatus 200 can include an electronic module 204. Inthis embodiment, some elements can be incorporated into an electronicsmodule 204 rather than the headset 201, to provide a long battery lifeconsistent with long work shifts. As an example, one or more componentsof circuitry 200 may be incorporated in the electronic module 204 and/orthe headset 201. In some example embodiments, the electronics module 204can be remotely coupled to a light-weight and comfortable headset 201secured to a worker head via a headband 209. In some exampleembodiments, the headband 209 can be a band that is designed to fit on aworker's head, in an ear, over an ear, or otherwise designed to supportthe headset. The headset 201 can include one or more speakers 202 andcan further include one or more microphones. For instance, in theembodiment illustrated in FIG. 2 , the headset 201 includes microphones203, 208. According to some example embodiments, the microphone 208 canprovide noise cancellation by continuously listening to and blockingenvironmental sounds to enhance voice recognition and optionally providefor noise cancellation. In some embodiments (not shown), the electronicsmodule 204 can be integrated into the headset 201 rather than beingremotely coupled to the headset 201. Various configurations of thevoice-controlled apparatus 200 can be used without deviating from theintent of the present disclosure.

In some example embodiments, the electronics module 204 can be used tooffload several components of the headset 201 to reduce the weight ofthe headset 201. In some embodiments, one or more of a rechargeable orlong life battery, display, keypad, Bluetooth® antenna, and printedcircuit board assembly (PCBA) electronics can be included in theelectronics module 204 and/or otherwise incorporated into thevoice-controlled apparatus 200.

In the embodiment illustrated in FIG. 2 , the headset 201 can be coupledto the electronics module 204 via a communication link such as a smallaudio cable 206 but could instead communicate with the electronicsmodule 204 via a wireless link. In an example embodiment, the headset201 can be of a low profile. For instance, headset 201 can beminimalistic in appearance in some embodiments, such as a Bluetoothearpiece/headphone.

According to some example embodiments the electronics module 204 can beconfigured to be used with various types of headsets 201. In someexample embodiments, the electronics module 204 can read a uniqueidentifier (I.D.) of the headset 201, which can be stored in thecircuitry of the voice-controlled apparatus 200 (e.g., the circuitry200) and can also be used to electronically couple the speakers andmicrophones to electronics module 204. In one embodiment, the audiocable 206 can includes multiple conductors or communication lines forsignals which can include a speaker +, speaker −, ground digital,microphone, secondary microphone, and microphone ground. In someexamples, the electronics module 204 can utilize a user configurableattachment 207, such as a plastic loop, to attach to a user. Forinstance, in the embodiment illustrated in FIG. 2 , the electronicsmodule 204 can be mounted to a worker torso via a lapel clip and/orlanyard. When a wireless link between the headset 201 and electronicsmodule 204 is used, such as a Bluetooth type of communication link, theheadset 201 can include a small lightweight battery. The communicationlink can provide wireless signals suitable for exchanging voicecommunications.

In some embodiments, voice templates for performing a speaker dependenttraining of a speech recognition model can be stored locally in theelectronic module 204 and/or the headset 201 as part of the circuitry200 to recognize a user's voice interactions and may convert theinteraction into text based data and commands for interaction with anapplication running in the circuitry 200. For example, thevoice-controlled apparatus 200 can perform voice recognition in oneembodiment utilizing the voice templates. According to some exampleembodiments, first few stages of voice recognition can be performed inthe voice-controlled apparatus 200, with further stages performed on aserver 105. In further embodiments, raw audio can be transmitted fromvoice-controlled apparatus 200 to the server 105 where the final stagesof voice recognition can be completed. Alternatively, in some exampleembodiments, the voice recognition can be performed on thevoice-controlled apparatus 200.

FIG. 3 illustrates an exemplary user device according to an exampleembodiment. In the embodiment illustrated in FIG. 3 , the user device isa handset 302 (e.g., a mobile device or tablet device). The handset 302may include one or more components of circuitry as explained withregards to FIG. 1 and may include one or more of the componentsdiscussed with regards to the headset of FIG. 2 (e.g., voice templates,speech encoders, etc.). The handset 302 may include one or moremicrophones 303 and one or more speakers 304, which may be connected toa set of headphones. The handset 302 can also include one or moreantenna. The microphone 303 receives speech or sound and transmits thereceived speech and sound to one or more components of circuitry 400 (tobe shown in FIG. 4 ) in the handset 302. The speakers 304 receive anaudio transmission from one or more components of circuitry 400 in thehandset 302 and output the audio transmission in the form of speech orsound. In an embodiment, the speakers 304 can also include noisecancellation. The handset 302 may connect with one or more otheroperator devices 103-103N and/or server 105 as explained with regards toFIG. 1 . For instance, in some embodiments, the handset 302 may connectto a wireless headphone via a Bluetooth connection or via an NFC module,where the wireless headphone includes a microphone and speaker forreceiving speech and outputting speech or sound. The handset 302 caninclude a speech recognizer unit to perform speech recognition of thespeech input. The handset 302 can also include a user input device andoutput device (such as the display 305 forming an interface) to send andreceive additional non-auditory information from circuitry 400, whetherincorporated into the handset 302 or in other operator devices 103-103Nand/or server 105. The display 305 of FIG. 3 may be a backlit LCD orOLED display. With the use of a handset 302 having one or moremicrophones 303 and one or more speakers 304, a user can communicatewith a central server (e.g., server 105) and/or with other user devices(e.g., operator devices 103-103N).

In the embodiment illustrated in FIG. 3 , the user device may include asensor 301 configured to determine the location of the user device andan LED 306 to provide notification or alert to the user. The sensor 301may include, but may not be limited to, a ground imaging sensor, anelectro-optic sensor, a GPS receiver, accelerometer, and the like. In anembodiment, the sensor 301 may determine a location of the user bydetermining GPS coordinates of the operator devices 103-103N and/or avehicle. The sensor 301 may communication or interact with othercomponents of the circuitry 400, such as processor 404, to determinewhether the user is in transit, such as in transit to a desiredlocation. The processor 404 may then interact with the display 305 tolock the display while the user is in transit or in motion. In otherembodiment, the display 305 can also facilitate user interaction via ahaptic touch or through a stylus pen. The processor 404 may also unlockthe display 305 when the user is determined to not be in transit or inmotion and/or has arrived at the desired location. One or moreapplications may be used to lock and unlock the display 305 depending onthe status of the user and/or user device.

Although FIG. 3 illustrates one example of a handheld device, variouschanges may be made to FIG. 3 . For example, all or portions of FIG. 3may represent or be included in other handheld devices and/or vehiclecommunication devices and may be used in conjunction with a headset suchas the headset of FIG. 2 . Also, the functional division shown in FIG. 3is for illustration only. Various components could be combined,subdivided, or omitted and additional components could be addedaccording to particular needs.

One suitable device for implementing the present disclosure may be theTALKMAN® product available from VOCOLLECT™ of Pittsburgh, Pa. Inaccordance with one aspect of the present disclosure, the user deviceuses a voice-driven system, which may use speech recognition technologyfor communication. In an embodiment, the user device may providehands-free voice communication between the user and the user device. Tothat end, digital information may be converted to an audio format, andvice versa, to provide speech communication between the user device oran associated system and the user. In an example embodiment, the userdevice may contain digital instructions or receive digital instructionsfrom a central computer and/or a server and may convert thoseinstructions to audio to be heard by the user. The user may then reply,in a spoken language, and the audio reply or the speech input may beconverted to a useable digital format to be transferred back to thecentral computer and/or the server. In other embodiments, the userdevice may operate independently, in an offline mode, such that speechdigitization, recognition and/or synthesis for implementing avoice-driven workflow solution may be performed by the user deviceitself.

FIG. 4 shows a schematic block diagram of circuitry 400, some or all ofwhich may be included in, for example, the voice-controlled apparatus101, the electronic device 102, the operator devices 103-103N, thesupervisor device 106, and/or the server 105. Any of the aforementionedsystems or devices may include the circuitry 400 and may be configuredto, either independently or jointly with other devices in a network 120perform the functions of the circuitry 400 described herein. Asillustrated in FIG. 4 , in accordance with some example embodiments,circuitry 400 can includes various means, such as memory 401,communications module 402, processor 404, and/or input/output module405. In some embodiments, workflow database 403 and/or workflow system406 may also or instead be included. As referred to herein, “module”includes hardware, software and/or firmware configured to perform one ormore particular functions. In this regard, the means of circuitry 400 asdescribed herein may be embodied as, for example, circuitry, hardwareelements (e.g., a suitably programmed processor, combinational logiccircuit, and/or the like), a computer program product comprisingcomputer-readable program instructions stored on a non-transitorycomputer-readable medium (e.g., memory 401) that is executable by asuitably configured processing device (e.g., processor 404), or somecombination thereof.

Processor 404 may, for example, be embodied as various means includingone or more microprocessors with accompanying digital signalprocessor(s), one or more processor(s) without an accompanying digitalsignal processor, one or more coprocessors, one or more multi-coreprocessors, one or more controllers, processing circuitry, one or morecomputers, various other processing elements including integratedcircuits such as, for example, an ASIC (application specific integratedcircuit) or FPGA (field programmable gate array), or some combinationthereof. Accordingly, although illustrated in FIG. 4 as a singleprocessor, in some embodiments processor 404 comprises a plurality ofprocessors. The plurality of processors may be embodied on a singlecomputing device or may be distributed across a plurality of computingdevices collectively configured to function as circuitry 400. Theplurality of processors may be in operative communication with eachother and may be collectively configured to perform one or morefunctionalities of circuitry 400 as described herein. In an exampleembodiment, processor 404 is configured to execute instructions storedin memory 401 or otherwise accessible to processor 404. Theseinstructions, when executed by processor 404, may cause circuitry 400 toperform one or more of the functionalities of circuitry 400 as describedherein.

Whether configured by hardware, firmware/software methods, or by acombination thereof, processor 404 may comprise an entity capable ofperforming operations according to embodiments of the present inventionwhile configured accordingly. Thus, for example, when processor 404 isembodied as an ASIC, FPGA or the like, processor 404 may comprisespecifically configured hardware for conducting one or more operationsdescribed herein. Alternatively, as another example, when processor 404is embodied as an executor of instructions, such as may be stored inmemory 401, the instructions may specifically configure processor 404 toperform one or more algorithms and operations described herein, such asthose discussed in connection with FIGS. 1-13 .

Memory 401 may comprise, for example, volatile memory, non-volatilememory, or some combination thereof. Although illustrated in FIG. 4 as asingle memory, memory 401 may comprise a plurality of memory components.The plurality of memory components may be embodied on a single computingdevice or distributed across a plurality of computing devices. Invarious embodiments, memory 401 may comprise, for example, a hard disk,random access memory, cache memory, read only memory (ROM), erasableprogrammable read-only memory (EPROM) & electrically erasableprogrammable read-only memory (EEPROM), flash memory, magneticcassettes, magnetic tape, magnetic disk storage or other magneticstorage devices, a compact disc read only memory (CD-ROM), digitalversatile disc read only memory (DVD-ROM), an optical disc, circuitryconfigured to store information, or some combination thereof. Memory 401may be configured to store information, data (including item data and/orprofile data), applications, instructions, or the like for enablingcircuitry 400 to carry out various functions in accordance with exampleembodiments of the present invention. For example, in at least someembodiments, memory 401 is configured to buffer input data forprocessing by processor 404. Additionally, or alternatively, in at leastsome embodiments, memory 401 is configured to store program instructionsfor execution by processor 404. Memory 401 may store information in theform of static and/or dynamic information. This stored information maybe stored and/or used by circuitry 400 during the course of performingits functionalities.

Communication module 402 may be embodied as any device or means embodiedin circuitry, hardware, a computer program product comprising computerreadable program instructions stored on a computer readable medium(e.g., memory 401) and executed by a processing device (e.g., processor404), or a combination thereof that is configured to receive and/ortransmit data from/to another device and/or network, such as, forexample, a second circuitry 400 and/or the like. In some embodiments,communication module 402 (like other components discussed herein) can beat least partially embodied as or otherwise controlled by processor 404.In this regard, communication module 402 may be in communication withprocessor 404, such as via a bus. Communication module 402 may include,for example, an antenna, a transmitter, a receiver, a transceiver,network interface card and/or supporting hardware and/orfirmware/software for enabling communications with another computingdevice. Communication module 402 may be configured to receive and/ortransmit any data that may be stored by memory 401 using any protocolthat may be used for communications between computing devices.Communication module 402 may additionally or alternatively be incommunication with the memory 401, input/output module 405 and/or anyother component of circuitry 400, such as via a bus.

Input/output module 405 may be in communication with processor 404 toreceive an indication of a user input and/or to provide an audible,visual, mechanical, or other output to a user (e.g., employee and/orcustomer). Some example visual outputs that may be provided to a user bycircuitry 400 are discussed in connection with FIGS. 1-13 . As such,input/output module 405 may include support, for example, for akeyboard, a mouse, a joystick, a display, a touch screen display, amicrophone, a speaker, a RFID reader, barcode reader, biometric scanner,and/or other input/output mechanisms. In embodiments wherein circuitry400 is embodied as a server or database, aspects of input/output module405 may be reduced as compared to embodiments where circuitry 400 isimplemented as an end-user machine (e.g., remote worker device and/oremployee device) or other type of device designed for complex userinteractions. In some embodiments (like other components discussedherein), input/output module 405 may even be eliminated from circuitry400. Alternatively, such as in embodiments wherein circuitry 400 isembodied as a server or database, at least some aspects of input/outputmodule 405 may be embodied on an apparatus used by a user that is incommunication with circuitry 400. Input/output module 405 may be incommunication with the memory 401, communication module 402, and/or anyother component(s), such as via a bus. One or more than one input/outputmodule and/or another component can be included in circuitry 400.

The workflow database 403 and the workflow system 406 may also orinstead be included and configured to perform the functionalitydiscussed herein related to workflow and/or identifying performancestatus associated with an execution of the workflow. In someembodiments, some or all of the functionality of generating and/orinformation for workflow and/or performance status associated withexecution of the workflow may be performed by processor 404. In thisregard, the example processes and algorithms discussed herein can beperformed by at least one processor 404, workflow database 403, and/orworkflow system 406. For example, non-transitory computer readable mediacan be configured to store firmware, one or more application programs,and/or other software, which include instructions and othercomputer-readable program code portions that can be executed to controleach processor (e.g., processor 404, workflow database 403, and/orworkflow system 406) of the components of circuitry 400 to implementvarious operations, including the examples shown above. As such, aseries of computer-readable program code portions are embodied in one ormore computer program goods and can be used, with a computing device,server, and/or other programmable apparatus, to producemachine-implemented processes.

FIG. 5 illustrates an exemplary block diagram of an electronics module502 in accordance with some embodiments of the present disclosure. Thecomponents illustrated in FIG. 5 may be in addition to one or morecomponents of the circuitry 400 shown in FIG. 4 , which may be part ofthe electronics module 502. In some embodiments, one or more of thecomponents illustrated in FIG. 5 may be included in the electronicsmodule 502 and/or other parts of the voice-controlled apparatus (200,101), the electronic device 102, operator devices 103-103N, supervisordevice 106, and/or server 105.

In the embodiment shown in FIG. 5 , the electronics module 502 caninclude an enclosure, such as plastic case, with a connector that canmate with a complimentary mating connector (not shown) on audio cable206 (as shown in FIG. 2 ). An internal path 511 can be used tocommunicate between multiple components within the electronics module502 enclosure. The electronics module 502 can utilize auser-configurable attachment feature 509, such as a plastic loop and/orother suitable features, for at least partially facilitating attachmentof the electronics module to the worker. In one embodiment, an inputspeech pre-processor (ISPP) 512 can convert input speech intopre-processed speech feature data. In some examples, an input speechencoder (ISENC) 513 can encode input speech for transmission to one ormore other parts of circuitry 400 for reconstruction and playback and/orrecording. Further, a raw input audio sample packet formatter 514 cantransmit the raw input audio to one or more other parts of circuitry 400using an application-layer protocol to facilitate communications betweenthe voice terminal and headset 201 as the transport mechanism. For thepurposes of the transport mechanism, the formatter 514 can be abstractedto a codec type referred to as Input Audio Sample Data (IASD). An outputaudio decoder (OADEC) 515 decodes encoded output speech and audio forplayback in the headset 201. According to some example embodiments, araw output audio sample packet reader 516 can operates to receive rawaudio packets from one or more other parts of circuitry 400 using thetransport mechanism. For the purposes of the transport mechanism, thisformatter 514 can be abstracted to a codec type referred to as OutputAudio Sample Data (OASD). A command processor 517 can adjusts theheadset hardware (e.g., input hardware gain level) under control of oneor more other parts of circuitry 400. Further, in some exampleembodiments, a query processor 518 can allow one or more other parts ofcircuitry 400 to retrieve information regarding headset operationalstatus and configuration. Further, path 511 can also be coupled tonetwork circuitry 519 to communicate via wired or wireless protocol withone or more other parts of circuitry 400. In some examples, the ISPP512, ISENC 513, and raw input audio formatter 514 can be sources ofcommunication packets used in the transport mechanism; the OADEC 515 andraw output audio reader 516 can be packet sinks. The command and queryprocessors 517, 518 are both packet sinks as well as sources (in generalthey generate acknowledgement or response packets).

FIG. 6 illustrates an example scenario depicting a communication anddata exchange between a user device 602 (e.g. a mobile device, a PDAetc.) being used by a user 601 and target device 604 positioned in acharging dock, in accordance with an example embodiment

The user device 602 and the target device 604 can be communicativelycoupled to each other via a Bluetooth classic connection, BLE (BluetoothLow Energy) protocol. Various other technologies can be employed such aswireless fidelity (Wi-Fi), light fidelity (LiFi), wireless gigabitalliance (WiGig), ZigBee, Near Field Communication (NFC), magneticsecure transmission, radio frequency (RF), Ultrasound, 5G mm wavetechnology, etc. In accordance with an example, the user device 602 canidentify the target device 604 in vicinity using NFC communication. Theuser device 602 on identifying the target device 604 can transferinformation to the target device 604 by employing, but not limited toany of the technologies listed above. In another embodiment, the targetdevice 604 can receive information from a server (not shown in figure)that is in communication with the target device 604 and the user device602 over a network. The network can include any wired or wirelesscommunication network including cellular telephone, an 802.11, 802.16,802.20, and/or WiMax network.

In an example embodiment, an NFC module (not shown in figure) of theuser device 602 can be enabled when the user 601 of the user device 602reaches within a predetermined distance of the target device 604. TheNFC module of the user device 602 can also be enabled in response aninput received from the user 601 of the user device 602. In an example,the input can include but not limited to voice command, haptic touch ona screen of the user device 602 or pressing a button on the user device602, etc. The user device 602 shown in FIG. 6 may not be limited tohaving display screen. The user device 602 without display screen canalso be used herein.

In regard to identification of the target device 604 by the user device602, in an example embodiment, the user 601 can identify the targetdevice 604 in response to the target device 604 notifying 603 the user601. The notification 603 can include, but not limited to activating aLED of the target device 604, playing a beep sound or audio tone,generating vibrations, flashing a display of the target device 604, orcan also include displaying a name or identification of the user 601 fore.g. name “John” intended for the target device 604. In some examples,the user device 602 can be coupled to a voice-controlled apparatus 101(shown in FIG. 1 ) to provide an audio message to the user 601 that thevoice-controlled apparatus 101 is connected for the user 601, for e.g.“John” (shown in FIG. 11 ).

In some example embodiment, the transfer of data or exchange of databetween the user device 602 and the target device 604 can take placeafter the target device 602 is identified as an intended device by theuser device 602.

In accordance with the example embodiment, the user 601 can use the userdevice 602 and the voice-controlled apparatus 101 (shown in FIG. 1 ) toperform one or more tasks of the workflow operation. In an exampleembodiment, the workflow operation can be an item picking operation forpicking one or more items, for example, from a storage location in thewarehouse. In this regard, in an example embodiment, the user 601 canwear the voice-controlled apparatus 101 (e.g. a headset device) andreceive instructions in form of voice prompts from the user device 602to perform various steps associated with the workflow operation. Forexample, the user 601 can receive one or more voice prompts on thevoice-controlled apparatus 101 that can include instructions (such asinstructions for, reaching a storage location, identifying items to bepicked, confirming the items for picking, and etc.) related to thepicking of the items.

In some examples, the workflow operation being performed with the userdevice 602 can be paused when a battery level of the user device 602 isdetermined to be below a threshold value, for example, the battery levelis less than 20 percent or remaining runtime of the battery is less thanone hour. In an alternate embodiment, the workflow operation beingperformed with the user device 602 can also be paused in response to theuser 601 issuing a voice command indicating that the battery level ofthe user device 602 is low. The threshold value for the user device 602can be defined by a central computing system or can be user-defined. Theworkflow operation can be resumed in the target device 604 after thedata is transferred to the target device 604 from the user device 602.

According to some alternate example embodiment, the workflow operationcan be resumed in the target device 604 in response to determinationthat the battery level of the target device 604 is above the thresholdvalue. The resumption of workflow operation can include user'sinteraction via the user device 602 or via the voice command.

FIG. 7 illustrates an exemplary embodiment of a method 700 for providingvoice-based communication and/or speech dialog between a user and anelectronic device. The method 700 may include generating speech for auser 701. In an embodiment, the voice-controlled apparatus (for example,200) can include output devices, such as, speakers for receiving digitalinstructions and/or commands from one or more components of thecircuitry in the voice-controlled apparatus and output the audiotransmission in the form of speech or sound.

The method 700 can further include receiving a speech input from a userin response 702. In accordance with one aspect of the presentdisclosure, the system can include a series of instances or junctureswhere an input is received from the user in response to the prompt. Forexample, a prompt asking a user for a desired location may request thata user provides an input, such as, speech input, providing locationinformation, in accordance with the invention. In an example embodiment,the voice-controlled apparatus, as described above, may further includeinput devices, such as a microphone for receiving speech inputs from auser. The microphone may further transmit the received speech input toone or more components of circuitry in the voice controllable device forfurther processing and recognition.

The method 700 can include digitizing the received speech input andprocessing digitized speech 703. In accordance with one aspect of thepresent disclosure, a microphone or other electro-acoustical componentsof the voice-controlled apparatus may receive a speech input from a userand may convert the speech input into an analog voltage signal.

The method 700 can further include performing speech recognition tomatch speech input to an expected response 704. In accordance with oneaspect of the present disclosure, a speech recognition search algorithmfunction, realized by an appropriate circuit and/or software in thevoice controllable device may analyze the features, as described above,to determine what hypothesis to assign to the speech input captured bythe microphone of the voice-controlled apparatus. As is known in theart, in one recognition algorithm, the recognition search relies onprobabilistic models provided through a database of suitable models torecognize the speech input. Each of the models in the database mayeither be customized to a user or be generic to a set of users.

Hidden Markov Models (HMM) may be used for the speech recognition. Inspeech recognition, these models may use sequences of states to describevocabulary items, which may be words, phrases, or sub word units. Asused herein, the term “word” may refer to a vocabulary item, and thusmay mean a word, a segment or part of a word, or a compound word, suchas “next slot” or “say again.” Therefore, the term “word” may not belimited to just a single word. Each state in an HMM may represent one ormore acoustic events and may serve to assign a probability to eachobserved feature vector. Accordingly, a path through the HMI states mayproduce a probabilistic indication of a series of acoustic featurevectors. The model may be searched such that different, competinghypotheses (or paths) are scored; a process known as acoustic matchingor acoustic searching. A state S may be reached at a time T via a numberof different paths. For each path reaching a particular state at aparticular time, a path probability may be calculated. Using the Viterbialgorithm, each path through the HMI may be assigned a probability. Inparticular, the best path may be assigned a probability. Furthermore,each word in the best path may be assigned a probability. Each of theseprobabilities may be used as a confidence factor or combined with othermeasurements, estimates or numbers to derive a confidence factor. Thepath with the highest confidence factor, the best hypothesis, can thenbe further analyzed.

When in operation, the search algorithm (which can be implemented usingHidden Markov Models with a Viterbi algorithm or other modelingtechniques such as template matching dynamic time warping (DTW) orneural networks), in essence, may compare the features generated, asdescribed above, with reference representations of speech, or speechmodels, in the database in order to determine the word or words thatbest match the speech input from the user device. In an embodiment, partof this recognition process may be to assign a confidence factor for thespeech to indicate how closely the sequence of features from the searchalgorithm matches the closest or best-matching models in the database.As such, a hypothesis consisting of one or more vocabulary items andassociated confidence factors may be directed to an acceptance algorithmto determine expected response. In accordance with the above embodiment,if the confidence factor is above a predetermined acceptance threshold,then the acceptance algorithm may decide to accept the hypothesis asrecognized speech. If, however, the confidence factor is not above theacceptance threshold, as utilized by the acceptance algorithm, then theacceptance algorithm may decide to ignore or reject the recognizedspeech. The user device may then prompt the user to repeat the speechinput. In this instance, the user may repeat the audio input provided tothe microphone.

The method 700 may further include executing the text request associatedwith the speech input 705. That is, a text request may be associatedwith the recognized speech and then acted upon after processing thespeech input.

FIGS. 8-9 illustrates a flow diagram representing a method 800 ofidentifying a second device by a first device for establishing acommunication between the first device and the second device so as tofacilitate swapping between the first device and the second device, inaccordance with an example embodiment.

At step 802, a first device (e.g. the user device 602) can receive avoice command from a worker in a workplace, the voice command can beindicative of a battery level of the first device. In this regard, asdescribed earlier, the worker performing the workflow operation with themobile device can issue a voice command indicating that the batterylevel of the mobile device.

At step 804, the first device can pause the workflow operation executingon the first device. In an example, as described in FIG. 6 , theon-going workflow execution can be paused in response to the user 601issuing a voice command indicating that the battery level of the userdevice 602 is low.

At step 806, the first device can perform a voice recognition to analyzethe voice command of the worker. In this regard, as described earlier inFIG. 7 , the speech recognition can be performed to match speech inputto an expected response.

The method at step 808 illustrates that the first device can activate acommunication module based on the voice recognition, to identify asecond device in proximity to the first device. As described earlier inFIG. 6 , the communication module here can be an NFC module of the userdevice 602 that can be enabled in response to an input received from theuser 601 of the user device 602. The target device 604 (herein referredto as second device) can be identified by the NFC module of the userdevice 602 (herein referred as first device). In an example, the inputcan include but not limited to the voice command issued by the user 601.

At step 902, the first device can terminate a connection with thewearable electronic device. According to some example embodiments, thewearable electronic device (e.g. the voice-controlled apparatus 101) canconnect with the first device or the second device via a Bluetoothclassic connection, BLE (Bluetooth Low Energy) protocol. Various othertechnologies can be employed here such as wireless fidelity (Wi-Fi),light fidelity (LiFi), wireless gigabit alliance (WiGig), ZigBee, NearField Communication (NFC), magnetic secure transmission, radio frequency(RF), Ultrasound, 5G mm wave technology, etc. In an alternateembodiment, the first device can be connected simultaneously withmultiple peripheral device such as headsets, scanners, pocket printers,PDTs, terminal devices using any of the above listed technologies.

At step 904, the first device can transfer information to the seconddevice. The information can include but not limited to user voicetemplates, tasks related information, configuration information andanother connected devices information.

The method 900 stops after step 904. In one or another embodiment, theabove steps can be performed between the first device and the seconddevice, without using any peripheral device, i.e. without the wearableelectronic device.

FIG. 10 illustrates an example scenario depicting swapping between afirst electronic device and a second electronic device, in accordancewith an example embodiment. The example scenario can include accesspoints 1001-1 and 1001-2 or a gateway device that can be capable ofcommunicating directly with one or more electronic devices (say, a firstelectronic device 1003 and a second electronic device 1006) and can alsobe capable of communicating (either directly or alternatively indirectlyvia a communication network such as the Internet or via a server) with anetwork establishment service (e.g. Internet service provider). Theaccess points 1001-1 and 1001-2, in FIG. 10 , can communicate with theelectronic devices (the first electronic device 1003 and the secondelectronic device 1006) via a Wi-Fi. Various other technologies can beemployed here such as light fidelity (LiFi), wireless gigabit alliance(WiGig), ZigBee, Near Field Communication (NFC), magnetic securetransmission, radio frequency (RF), Ultrasound, 5G mm wave technology,etc. The access points 1001-1 and 1001-2, in FIG. 10 , can be directlycoupled to a WMS (Workflow management system) 1002 via a wiredconnection.

The first electronic device 1003 and the second electronic device 1006can communicate with a first headset 1005-1 and a second headset 1005-2respectively via Bluetooth connection. Also, the first electronic device1003 and the second electronic device 1006 can communicate with a firstreader 1004-1 and a second reader 1004-2 respectively via the Bluetoothconnection. As mentioned earlier, the first electronic device 1003 andthe second electronic device 1006 can be connected simultaneously withmultiple peripheral device such as headsets, scanners, pocket printers,PDTs, terminal devices using but not limited to BLE, wireless fidelity(Wi-Fi), light fidelity (LiFi), wireless gigabit alliance (WiGig),ZigBee, Near Field Communication (NFC), magnetic secure transmission,radio frequency (RF), Ultrasound, 5G mm wave technology, etc.

In one embodiment, a user may carry the first electronic device 1003that can be connected to the first headset 1005-1 to perform workflowoperation. The user performing the workflow operation, for example,picking operation in a warehouse may notice a battery level indicator ofthe first electronic device 1003 indicating that the battery of thefirst electronic device is about to drain. The user speaks a voicecommand corresponding to lower battery state of the first electronicdevice 1003. The user can then travel to a charging station 1007 havingplurality of charged electronic devices to pick the second electronicdevice 1006 in fully charged state. This enables the user to swap thefirst electronic device 1003 with the second device 1006 for performingthe workflow operation. A speech recognizer (as described in FIG. 3 ) ofthe first electronic device 1003 can perform a voice recognition toanalyze the voice command of the user. In an alternate embodiment, thevoice recognition of the voice command can be performed on the firstheadset 1005-1 (as described earlier in FIG. 2 , the voice-controlledapparatus 200 can correspond to a headset that can include a wirelessenabled voice recognition device). In this regard, the workflowoperation being performed in the first electronic device 1003 can bepaused. A point at which the workflow operation paused can be storedtemporarily in a stack memory of the first electronic device 1003.

Based on analyzing the voice command of the user, a communicationmodule, for example but not limited to an NFC module (not shown infigures) associated with the first electronic device 1003 can beactivated to identify a target device. The target device herein referredto the second electronic device 1006. The target device can be a devicethat is positioned in the charging station or a charging dock 1007. Thecharging station 1007 can include plurality of devices that are eithercompletely charged or being in process of charging. In an alternateembodiment, the user can reach to the charging station 1007 and thenmanually activate the NFC module of the first electronic device 1003 toidentify the target device. The manual activation can include eitherpressing a button on the first electronic device 1003 or provide aspeech input to turn ON the NFC module. In another exemplary embodiment,the NFC module of the first electronic device 1003 can be automaticallyactivated for identification of the target device, in response to theuser of the first electronic device 1003 reaching within a predefineddistance of the target device, i.e. the second electronic device 1006.In some examples, the second electronic device 1006 can be identified asthe target device when a LED light of the second electronic device 1006starts blinking. The blinking of the LED starts when the firstelectronic device 1003 reaches within the predefined distance of thesecond electronic device 1006. The blinking of the LED can also beinitiated in response to the user pressing the button of the firstelectronic device 1003. In an alternate embodiment, the blinking of theLED can also be initiated in response to the first electronic device1003 reaching within the predefined distance of the second electronicdevice 1006 and the button on the first electronic device 1003 beingpressed.

In yet another exemplary embodiment, the first electronic device 1003and the second electronic device 1006 can be connected for data transferby placing the first electronic device 1003 over the second electronicdevice 1006 in proper alignment. For example, a bottom surface of thefirst electronic device 1003 can be placed over a top surface of thesecond electronic device 1006 or vice-versa to connect both the devicesfor data transfer. The successful connection of both the firstelectronic device 1003 and the second electronic device 1006 can beindicated based on LEDs of both the first electronic device 1003 and thesecond electronic device 1006 flashing in synchronization. In anotherexample embodiment, the process of connecting the devices can includeactivating the first electronic device 1003 in sender mode and thesecond electronic device 1006 in receiver mode by pressing buttons onthe first electronic device 1003 and the second electronic device 1006.

Once the NFC module of the first electronic device 1003 is enabled, allthe connections of the first electronic devices 1003 with peripheraldevices, for example, the first headset 1005-1 and the first reader1004-1 can be terminated. In this regard, the first electronic device1003 can then initiate transfer of information from the first electronicdevice 1003 to the second electronic device 1006 via a Wi-Fi network.Various other technologies can be employed here such as light fidelity(LiFi), wireless gigabit alliance (WiGig), ZigBee, Near FieldCommunication (NFC), magnetic secure transmission, radio frequency (RF),Ultrasound, 5G mm wave technology, etc.

In an example embodiment, the information can be stored on the WMS 1002by the first electronic device 1003. The second electronic device 1006can send a request to the WMS 1002 via the access point 1001-2 toprovide the information required for performing the workflow operation.In response to the request, the WMS 1002 can provide the information tothe second electronic device 1006. According to some example, theinformation can be downloaded directly by the second electronic device1006 from the WMS 1002. The information can include but not limited touser voice templates, tasks related information, configurationinformation and another connected devices information.

The second electronic device 1006 can then establish connections withthe peripheral devices such as the second headset 1005-2 and the secondreader 1004-2. In an example embodiment, the second electronic device1006 can establish connections with the first headset 1005-1 and thefirst reader 1004-1 to resume the workflow operation. This facilitatesthe user of the second electronic device 1006 to use same peripheraldevices (i.e., the first headset 1005-1 and the first reader 1004-1)that were being used earlier with the first electronic device 1003before the swapping. In some examples, the connection between the secondelectronic device 1006 and the peripheral devices can also beestablished when surfaces of the second electronic device 1006 and theperipheral devices touch each other for a period of time. For example,the second electronic device 1006 can be tapped against the secondheadset 1005-2 to establish the connection between them. This can beapplied to the first electronic device 1003 and its peripheral devicesas well.

The successful swapping of the first electronic device 1003 to thesecond electronic device 1006 can be notified to the user by playing anaudio message to the user. For example, the second headset 1005-2connected to the second electronic device 1006 can play the message“Headset Connected for operator John”. In response, the user can confirmthe swapping indicating that he is an intended user for the secondelectronic device 1006 to perform the workflow operation.

The workflow operation can be resumed in the second electronic device1006 from the point it was terminated and stored in the stack memory. Inan example embodiment, the workflow operation can also be resumed byissuing commands to the second electronic device 1006 from the WMS 1002.

FIG. 11 illustrates another example scenario depicting swapping betweena first electronic device and a second electronic device, in accordancewith an example embodiment. The example scenario can include accesspoints 1101-1 and 1101-2 or a gateway device that can be capable ofcommunicating directly with one or more electronic devices (say, a firstelectronic device 1103 and a second electronic device 1106) and can alsobe capable of communicating (either directly or alternatively indirectlyvia a communication network such as the Internet or via a server) with anetwork establishment service (e.g. Internet service provider). Theaccess points 1101-1 and 1101-2, in FIG. 11 , can communicate with theelectronic devices (the first electronic device 1103 and the secondelectronic device 1106) via a Wi-Fi network. Various other technologiescan be employed here such as light fidelity (LiFi), wireless gigabitalliance (WiGig), ZigBee, Near Field Communication (NFC), magneticsecure transmission, radio frequency (RF), Ultrasound, 5G mm wavetechnology, etc. As explained earlier in FIG. 10 , the access points1101-1 and 1101-2, can be directly coupled to a WMS (Workflow managementsystem) via a wired connection.

The first electronic device 1103 and the second electronic device 1106can communicate with a first headset 1105-1 and a second headset 1105-2respectively via a Bluetooth connection. Also, the first electronicdevice 1103 and the second electronic device 1106 can communicate with afirst reader 1104-1 and a second reader 1104-2 respectively via theBluetooth connection. As mentioned earlier, the first electronic device1103 and the second electronic device 1106 can be connectedsimultaneously with multiple peripheral device such as headsets,scanners, pocket printers, PDTs, terminal devices using but not limitedto BLE, wireless fidelity (Wi-Fi), light fidelity (LiFi), wirelessgigabit alliance (WiGig), ZigBee, Near Field Communication (NFC),magnetic secure transmission, radio frequency (RF), Ultrasound, 5G mmwave technology, a wired ethernet network etc.

In an example, a user can carry the first electronic device 1103 toperform a workflow operation, e.g. perform a pick task in a warehouse.The first electronic device 1103 can be connected to peripheral devicessuch as the first headset 1105-1 and the first reader 1104-1 whileperforming the workflow operation. As already explained in detaileddescription, the WMS 1102 can monitor battery levels of all theelectronic devices (for example, the first electronic device 1103, thesecond electronic device 1106, and other electronic device placed in acharging dock 1107) being used by workers for performing the workflowoperations. The WMS 1102 can directly communicate to each of theelectronic devices through a combination of a wired network and awireless network. In another example, the WMS 1102 can communicate withthe electronic devices via the access points 1101-1 and 1101-2.

In an exemplary embodiment, the WMS 1102 can direct the first electronicdevice 1103 to perform a set of tasks through a plurality of commands.The commands can be, but not limited to voice commands to the user ofthe first electronic device 1103 via the first headset 1105-1. Inresponse, the user can send voice response back to the WMS 1102 as apart of the workflow operation. For example, the WMS 1102 can issue acommand to “Go to Location A, Aisle 8, Slot 2”. The user after reachingto a location can send the voice response “Ok. Reached Location A, Aisle8, Slot 2”.

The WMS 1102 can determine that a battery level of the first electronicdevice 1103 is low or about to drain soon. In some scenarios, thebattery level determination can be done by the first electronic device1103 itself. The WMS 1102 can then send a notification to the firstelectronic device 1103 informing to the user of the first electronicdevice 1103 that the battery is below a predefined threshold value. Thepredefined threshold value can be, for example, but not limited to thebattery level less than 20 percent or remaining runtime of the batteryis less than one hour. The predefined threshold value can be defined bythe WMS 1102 or can be user-defined. The predefined threshold value canbe determined by the WMS 1102 based on at least one of a type of a taskbeing performed by the user, a priority level of the task allocated tothe user, or a predefined break duration of the user. The notificationto the first electronic device 1103 can be, but not limited to an audioalert, a visual alert, or a warning message on the first electronicdevice 1103. In some cases, the user of the first electronic device 1103can be asked to provide either an acceptance or a rejection to thenotification. The user can accept or reject the notification by giving avoice input “Accept/Reject” or by touching on ACCEPT option beingdisplayed on a display screen of the first electronic device 1103. Theuser can also delay swapping process by selecting REJECT option in thedisplay screen.

Once the user confirms that the swapping of devices is needed, the WMS1102 can then determine based on a current location of the firstelectronic device 1103, a list of devices in the charging dock 1107available for swapping. The charging station 1007 can include pluralityof devices that are either completely charged or being in process ofcharging. The WMS 1102 can then select a target device (herein referredas, the second electronic device 1106) from the charging dock 1107. Inan embodiment, the WMS 1102 can send instructions to first electronicdevice 1103 to reach to the target device i.e., the second electronicdevice 1106. The instructions can comprise a location information of thesecond electronic device 1106, a shortest route information to reach tothe second electronic device 1106. The instructions can be given eithervisually or vocally. In an example, the shortest route information maycomprise a map displayed on the display screen of the first electronicdevice 1103. The user of the first electronic device 1103 can use themap to reach to the second electronic device 1106 for swapping the firstelectronic device 1103 with the second electronic device 1106.

Meanwhile, the WMS 1102 can prepare the second electronic device 1106for swapping by sending information to the second electronic device1106. The information can be stored on the WMS 1102 by the firstelectronic device 1103. According to some example, the information canbe downloaded directly by the second electronic device 1106 from the WMS1102. In some cases, the information can be transferred from the firstelectronic device 1103 to the second electronic device 1106 when thefirst electronic device 1103 reaches in proximity of the secondelectronic device 1106. The information can include but not limited touser voice templates, tasks related information, configurationinformation and another connected devices information.

The user of the first electronic device 1103 follows the given commandsto reaches to the charging dock 1107 to pick up the second electronicdevice 1106 selected as a swapping device. The user can identify thesecond electronic device 1106 in the charging dock 1107 by reading atext flashing on a screen of the second electronic device 1106. Withregards to FIG. 11 , suppose a user named “John” of the first electronicdevice 1103 reaches to the charging dock 1107, the second electronicdevice 1106 selected for swapping by the WMS 1102 may display “John” ina screen of the second electronic device 1106. In this way, the user canidentify the second electronic device 1106 in the charging dock 1107.The screen of the second electronic device 1106, in an example, maycontinue to display the name of the user for a period of time or untilthe user picks up the second electronic device 1106 from the chargingdock 1107. In an alternate embodiment, the second electronic device 1106may initiate flashing the name of the user of the first electronicdevice 1103 in response to the user of the first electronic device 1103reaching within a predefined distance of the target device, i.e. thesecond electronic device 1106. The flashing of the name of the user onthe screen of the second electronic device 1106 can also be initiated inresponse to the user pressing a button of the first electronic device1103.

Once the user reaches to the charging dock 1107 or near the secondelectronic device 1106, all the connections of the first electronicdevices 1103 with peripheral devices, for example, the first headset1105-1 and the first reader 1104-1 can be terminated. In this regard,the first electronic device 1103 can then initiate transfer ofinformation from the first electronic device 1103 to the secondelectronic device 1106 via a Wi-Fi network. Various other technologiescan be employed here such as light fidelity (LiFi), wireless gigabitalliance (WiGig), ZigBee, Near Field Communication (NFC), magneticsecure transmission, radio frequency (RF), Ultrasound, 5G mm wavetechnology, etc.

In some examples, the first electronic device 1103 and the secondelectronic device 1106 can be connected for data transfer by placing thefirst electronic device 1103 over the second electronic device 1106 inproper alignment.

In an exemplary embodiment, the user can then pick up the secondelectronic device 1106 from the charging dock 1107 for performing theworkflow operation. The user can also the place the first electronicdevice 1103 in the charging dock 1107 for charging. Once the user picksup the second electronic device 1106, he can be asked via a visualmessage to confirm that the second electronic device 1106 is the correctand intended device for swapping. The user then can provide confirmationby any one of: a voice input, entering a password or unique login ID,providing biometric information, pressing a confirm button on the screenof the second electronic device 1106, or selecting a confirm option.Based on the confirmation, the second electronic device 1106 can beverified as the intended device for swapping and performing the workflowoperation.

The second electronic device 1106 can then establish connections withperipheral devices such as a second headset 1105-2 and a second reader1104-2. In an example embodiment, the second electronic device 1106 canestablish connections with the first headset 1105-1 and the first reader1104-1 to resume the workflow operation. This facilitates the user ofthe second electronic device 1106 to use same peripheral devices (i.e.,the first headset 1105-1 and the first reader 1104-1) that were beingused earlier with the first electronic device 1103 before the swapping.There might be no need to change to the new peripheral devices (i.e. thesecond headset 1105-2 and the second reader 1104-2) to perform theworkflow operation. In some example, the second electronic device 1106can be tapped against the peripheral devices (the second headset 1105-2and the second reader 1104-2) for a period of time to establish theconnection between them. This can be applied to the first electronicdevice 1103 and its peripheral devices as well.

The successful swapping of the first electronic device 1103 to thesecond electronic device 1106 can be notified to the user by playing anaudio message to the user. For example, the second headset 1105-2connected to the second electronic device 1106 can play the message“Headset Connected for operator John”. In response, the user can confirmthe swapping indicating that he is an intended user for the secondelectronic device 1106 to perform the workflow operation. The connectionof other peripheral devices such as the second reader 1104-2 with thesecond electronic device 1106 can be confirmed in response to the secondreader 1104-2 flashing an LED associated with the second reader 1104-2.The flashing of the LED indicates that the second reader is a correctperipheral device for the second electronic device 1106. In an exampleembodiment, the flashing of the LED can be initiated in response to theuser of the second electronic device 1106 issuing a voice command orproviding a gesture, for example, “what are the peripheral devices forJohn”. The voice command can be recognized, and all the peripheraldevices connected with the second electronic device 1106 can startgenerating alert, for example, blinking LED, playing audio beep, orvibrating. This enables the user to identify the peripheral devicesconnected with the second electronic device 1106.

The workflow operation can be resumed in the second electronic device1106 from the point it was terminated and stored in the stack memory. Inan example embodiment, the workflow operation can be resumed by issuingcommands to the second electronic device 1106 from the WMS 1102.

FIG. 12 illustrates a schematic view 1200 of an example electronicdevice (e.g. the electronic device 102, the operator devices 103-103N,the supervisor device 106 etc.), in accordance with an exampleembodiment described herein. In some example embodiments, the electronicdevice 102 can correspond to a mobile handset. FIG. 12 illustrates is aschematic block diagram of an example end-user device such as a userequipment that can be the electronic device 102 used by an operator forexecuting one or more tasks of a workflow.

Although, FIG. 12 illustrates a mobile handset, it will be understoodthat other devices can be any electronic device as described in FIG. 1 ,and that the mobile handset is merely illustrated to provide context forthe embodiments of the various embodiments described herein. To thisend, the following discussion is intended to provide a brief, generaldescription of an example of a suitable environment in which the variousembodiments can be implemented. While the description includes a generalcontext of computer-executable instructions embodied on amachine-readable storage medium, those skilled in the art will recognizethat the various embodiments also can be implemented in combination withother program modules and/or as a combination of hardware and software.

Generally, applications (e.g., program modules) can include routines,programs, components, data structures, etc., described herein inaccordance with example embodiments, that can perform particular tasksor implement particular abstract data types. Moreover, those skilled inthe art will appreciate that the methods described herein can bepracticed with other system configurations, including single-processoror multiprocessor systems, minicomputers, mainframe computers, as wellas personal computers, hand-held computing devices, microprocessor-basedor programmable consumer electronics, and the like, each of which can beoperatively coupled to one or more associated devices.

According to some example embodiments, the electronic device 102, theoperator devices 103-103N, and the voice-controlled apparatus 101 cantypically include a variety of machine-readable media. Machine-readablemedia can be any available media that can be accessed by the computerand includes both volatile and non-volatile media, removable andnon-removable media. By way of example and not limitation,computer-readable media can comprise computer storage media andcommunication media. Computer storage media can include volatile and/ornon-volatile media, removable and/or non-removable media implemented inany method or technology for storage of information, such ascomputer-readable instructions, data structures, program modules orother data. Computer storage media can include, but is not limited to,RAM, ROM, EEPROM, flash memory or other memory technology, CD ROM,digital video disk (DVD) or other optical disk storage, magneticcassettes, magnetic tape, magnetic disk storage or other magneticstorage devices, or any other medium which can be used to store thedesired information and which can be accessed by the computer.

According to some example embodiments described herein, a communicationmedia typically embodies computer-readable instructions, datastructures, program modules or other data in a modulated data signalsuch as a carrier wave or other transport mechanism and includes anyinformation delivery media. In this regard, the term “modulated datasignal” can correspond to a signal that has one or more of itscharacteristics set or changed in such a manner as to encode informationin the signal. By way of example, and not limitation, communicationmedia includes wired media such as a wired network or direct-wiredconnection, and wireless media such as acoustic, RF, infrared and otherwireless media. Combinations of the any of the above may also beincluded within the scope of computer-readable media.

According to some example embodiments, the mobile handset can comprise aprocessor 1224 for controlling and processing all onboard operations andfunctions. A memory 1226 interfaces to the processor 1224 for storage ofdata and one or more applications 1214 (e.g., a video player software,user feedback component software, etc.). Other applications can includevoice recognition of predetermined voice commands that facilitateinitiation of the user feedback signals. The applications 1214 can bestored in the memory 1226 and/or in a firmware 1202 and executed by theprocessor 1224 from either or both the memory 1226 or/and the firmware1202. The firmware 1202 can also store startup code for execution ininitializing the mobile handset. A communications component 1234interfaces to the processor 1224 to facilitate wired/wirelesscommunication with external systems, e.g., cellular networks, VoIPnetworks, and so on. Here, the communications component 1234 can alsoinclude a suitable cellular transceiver 1236 (e.g., a GSM transceiver)and/or an unlicensed transceiver 1238 (e.g., Wi-Fi, WiMAX) forcorresponding signal communications. The mobile handset can be a devicesuch as a cellular telephone, a PDA with mobile communicationscapabilities, and messaging-centric devices. The communicationscomponent 1234 also facilitates communications reception fromterrestrial radio networks (e.g., broadcast), digital satellite radionetworks, and Internet-based radio services networks.

The mobile handset can also comprise a display 1206 (e.g. displayscreen) for displaying text, images, video, telephony functions (e.g., aCaller ID function), setup functions, and for user input. For example,the display 1206 can also be referred to as a “screen” that canaccommodate the presentation of multimedia content (e.g., musicmetadata, messages, wallpaper, graphics, etc.). The display 1206 canalso display videos and can facilitate the generation, editing andsharing of video quotes. A serial I/O interface 1210 is provided incommunication with the processor 1224 to facilitate wired and/orwireless serial communications (e.g., USB, and/or IEEE 1384) through ahardwire connection, and other serial input devices (e.g., a keyboard,keypad, and mouse). This support updating and troubleshooting the mobilehandset, for example. Audio capabilities are provided with an audio I/Ocomponent 1228, which can include a speaker for the output of audiosignals related to, for example, indication that the user pressed theproper key or key combination to initiate the user feedback signal. Theaudio I/O component 1228 also facilitates the input of audio signalsthrough a microphone to record data and/or telephony voice data, and forinputting voice signals for telephone conversations.

The mobile handset can also comprise a slot interface 1230 foraccommodating a SIC (Subscriber Identity Component) in the form factorof a card Subscriber Identity Module (SIM) or universal SIM 1232 andinterfacing the SIM card 1232 with the processor 1224. However, it is tobe appreciated that the SIM card 1232 can be manufactured into themobile handset and updated by downloading data and software.

The mobile handset can also process IP data traffic through thecommunication component 1234 to accommodate IP traffic from an IPnetwork such as, for example, the Internet, a corporate intranet, a homenetwork, a person area network, etc., through an ISP or broadband cableprovider. Thus, VoIP traffic can be utilized by the mobile handset andIP-based multimedia content can be received in either an encoded ordecoded format.

A video processing component 1208 (e.g., a camera) can be provided fordecoding encoded multimedia content. The video processing component 1208can aid in facilitating the generation, editing, and sharing of videoquotes. The mobile handset also includes a power source 1242 in the formof batteries and/or an AC power subsystem, which power source 1242 caninterface to an external power system or charging equipment (not shown)by a power I/O component 1244.

According to some example embodiments, the mobile handset can alsocomprise a video component 1204 for processing video content receivedand, for recording and transmitting video content. For example, thevideo component 1204 can facilitate the generation, editing and sharingof video quotes. In some example embodiments, a location trackingcomponent 1240 facilitates geographically locating the mobile handset.As described hereinabove, this can occur when the user initiates thefeedback signal automatically or manually. According to some exampleembodiments, a user input component 1212 facilitates the user initiatingthe quality feedback signal. In this regard, in some examples, the userinput component 1212 can also facilitate the generation, editing andsharing of video quotes. According to various example embodimentsdescribed herein, the user input component 1212 can include suchconventional input device technologies such as a keypad, keyboard,mouse, stylus pen, and/or touch screen, for example.

Referring again to the applications 1214, a hysteresis component 1220can facilitate the analysis and processing of hysteresis data, which isutilized to determine when to associate with the access point. Asoftware trigger component 1218 can be provided that facilitatestriggering of the hysteresis component 1220 when the Wi-Fi transceiver1238 detects the beacon of the access point. A SIP client 1222 enablesthe mobile handset to support SIP protocols and register the subscriberwith the SIP registrar server. In some example embodiments, theapplications 1214 can also include a client 1216 that provides at leastthe capability of discovery, play and store of multimedia content, forexample, music.

In some example embodiments, the mobile handset, as indicated aboverelated to the communications component 1234, includes an indoor networkradio transceiver 1238 (e.g., Wi-Fi transceiver). This function cansupport the indoor radio link, such as IEEE 802.11, for the dual-modeGSM handset. In some example embodiments, the mobile handset canaccommodate at least satellite radio services through a handset that cancombine wireless voice and digital radio chipsets into a single handhelddevice.

FIG. 13 illustrates a schematic view of another example of an electronicdevice 1300, in accordance with another example embodiment describedherein. According to some example embodiments, the electronic device1300 illustrated in FIG. 13 can correspond to the electronic device 102,the operator devices 103-103N, the supervisor device 106, and/or theserver 105, as described in reference to FIGS. 1-12 .

Referring now to FIG. 13 , there is illustrated a block diagram ofoperable to execute the functions and operations performed in thedescribed example embodiments. In some example embodiments, theelectronic device 1300 can provide networking and communicationcapabilities between a wired or wireless communication network and aserver and/or communication device. In order to provide additionalcontext for various aspects thereof, FIG. 13 and the followingdiscussion are intended to provide a brief, general description of asuitable computing environment in which the various aspects of theembodiments can be implemented to facilitate the establishment of atransaction between an entity and a third party. While the descriptionabove is in the general context of computer-executable instructions thatcan run on one or more computers, those skilled in the art willrecognize that the various embodiments also can be implemented incombination with other program modules and/or as a combination ofhardware and software.

According to said example embodiments, program modules include routines,programs, components, data structures, etc., that perform particulartasks or implement particular abstract data types. Moreover, thoseskilled in the art will appreciate that the inventive methods can bepracticed with other computer system configurations, includingsingle-processor or multiprocessor computer systems, minicomputers,mainframe computers, as well as personal computers, hand-held computingdevices, microprocessor-based or programmable consumer electronics, andthe like, each of which can be operatively coupled to one or moreassociated devices.

The illustrated aspects of the various embodiments can also be practicedin distributed computing environments where certain tasks are performedby remote processing devices that are linked through a communicationsnetwork. In a distributed computing environment, program modules can belocated in both local and remote memory storage devices.

In accordance with some example embodiments, computing devices typicallyinclude a variety of media, which can include computer-readable storagemedia or communications media, which two terms are used hereindifferently from one another as follows.

According to some example embodiments, a computer-readable storage mediacan be any available storage media that can be accessed by the computerand includes both volatile and nonvolatile media, removable andnon-removable media. By way of example, and not limitation,computer-readable storage media can be implemented in connection withany method or technology for storage of information such ascomputer-readable instructions, program modules, structured data, orunstructured data. Computer-readable storage media can include, but arenot limited to, RAM, ROM, EEPROM, flash memory or other memorytechnology, CD ROM, digital versatile disk (DVD) or other optical diskstorage, magnetic cassettes, magnetic tape, magnetic disk storage orother magnetic storage devices, or other tangible and/or non-transitorymedia which can be used to store desired information. Computer-readablestorage media can be accessed by one or more local or remote computingdevices, e.g., via access requests, queries or other data retrievalprotocols, for a variety of operations with respect to the informationstored by the medium.

In some examples, communications media can embody computer-readableinstructions, data structures, program modules or other structured orunstructured data in a data signal such as a modulated data signal,e.g., a carrier wave or other transport mechanism, and includes anyinformation delivery or transport media. The term “modulated datasignal” or signals refers to a signal that has one or more of itscharacteristics set or changed in such a manner as to encode informationin one or more signals. By way of example, and not limitation,communication media include wired media, such as a wired network ordirect-wired connection, and wireless media such as acoustic, RF,infrared and other wireless media.

With reference to FIG. 13 , implementing various aspects describedherein with regards to the end-user device can comprise the electronicdevice (or referred as computing device 1300) comprising a processingunit 1302, a system memory 1303 and a system bus 1301. The system bus1301 can be configured to couple system components including, but notlimited to, the system memory 1303 to the processing unit 1302. In someexample embodiments, the processing unit 1302 can be any of variouscommercially available processors. To this end, in some examples, dualmicroprocessors and other multi-processor architectures can also beemployed as the processing unit 1302.

According to some example embodiments, the system bus 1301 can be any ofseveral types of bus structure that can further interconnect to a memorybus (with or without a memory controller), a peripheral bus, and a localbus using any of a variety of commercially available bus architectures.In some examples, the system memory 1303 can comprise, read-only memory(ROM) 1305 and random-access memory (RAM) 1304. According to someexample embodiments, a basic input/output system (BIOS) is stored in anon-volatile memory 1305 such as ROM, EPROM, EEPROM, which BIOS containsthe basic routines that help to transfer information between elementswithin the computing device 1300, such as during start-up. The RAM 1304can also comprise a high-speed RAM such as static RAM for caching data.

According to some example embodiments, the computing device 1300 canfurther comprise an internal hard disk drive (HDD) 1312 (e.g., EIDE,SATA), which internal hard disk drive 1312 can also be configured forexternal use in a suitable chassis (not shown), a magnetic floppy diskdrive (FDD) 1313, (e.g., to read from or write to a removable diskette1314) and an optical disk drive 1315, (e.g., reading a CD-ROM disk or,to read from or write to other high capacity optical media such as theDVD). In some examples, the hard disk drive 1312, magnetic disk drive1313 and optical disk drive 1315 can be connected to the system bus 1301by a hard disk drive interface 1306, a magnetic disk drive interface1307 and an optical drive interface 1308, respectively. According tosome example embodiments, the interface 1306 for external driveimplementations can comprise, at least one or both of Universal SerialBus (USB) and IEEE 1394 interface technologies. Other external driveconnection technologies are within contemplation of the subjectembodiments.

According to some example embodiments described herein, the drives andtheir associated computer-readable media provide nonvolatile storage ofdata, data structures, computer-executable instructions, and so forth.For the electronic device the drives and media accommodate the storageof any data in a suitable digital format. Although the description ofcomputer-readable media above refers to a HDD, a removable magneticdiskette, and a removable optical media such as a CD or DVD, it may beappreciated by those skilled in the art that other types of media whichare readable by an electronic device, such as zip drives, magneticcassettes, flash memory cards, cartridges, and the like, can also beused in the example operating environment, and further, that any suchmedia can contain computer-executable instructions for performing themethods of the disclosed embodiments.

In some example embodiments, a number of program modules can be storedin the drives and RAM 1304, including an operating system 1319, one ormore application programs 1320, other program modules 1321 and programdata 1322. To this end, in some examples, all or portions of theoperating system, applications, modules, and/or data can also be cachedin the RAM 1304. It is to be appreciated that the various embodimentscan be implemented with various commercially available operating systemsor combinations of operating systems.

According to some example embodiments, a user can enter commands andinformation into the computing device through one or more wired/wirelessinput devices, e.g., a keyboard 1325 and a pointing device, such as amouse 1326. Other input devices (not shown) may include a microphone, anIR remote control, a joystick, a game pad, a stylus pen, touch screen,or the like. In some examples, these and other input devices are oftenconnected to the processing unit 1302 through an input device interface1310 that is coupled to the system bus 1301, but can be connected byother interfaces, such as a parallel port, an IEEE 1384 serial port, agame port, a USB port, an IR interface, etc.

According to some example embodiments, a monitor 1324 or other type ofdisplay device can also be connected to the system bus 1301 through aninterface, such as a video adapter 1309. In addition to the monitor1324, the computing device 1300 can also comprise other peripheraloutput devices (not shown), such as speakers, printers, etc.

According to some example embodiments, the computing device 1300 canoperate in a networked environment using logical connections by wiredand/or wireless communications to one or more remote computers, such asa remote computer(s) 1327. In some examples, the remote computer(s) 1327can be a workstation, a server computer, a router, a personal computer,portable computer, microprocessor-based entertainment device, a peerdevice or other common network node, and typically includes many or allof the elements described relative to the computer, although, forpurposes of brevity, only a memory/storage device 1328 is illustrated.According to some example embodiments, the logical connections depictedinclude wired/wireless connectivity to a local area network (LAN) 1330and/or larger networks, e.g., a wide area network (WAN) 1329. Such LANand WAN networking environments are commonplace in offices andcompanies, and facilitate enterprise-wide computer networks, such asintranets, all of which may connect to a global communications network,e.g., the Internet.

In some examples, when used in a LAN networking environment, thecomputing device 1300 can be connected to the LAN 1330 through a wiredand/or wireless communication network interface or adapter 1311. Theadapter 1311 may facilitate wired or wireless communication to the LAN1330, which may also include a wireless access point disposed thereonfor communicating with the wireless adapter 1311.

In alternate examples, when used in a WAN networking environment, thecomputing device 1300 can include a modem 1318, or can be connected to acommunications server on the WAN 1329 or has other means forestablishing communications over the WAN 1329, such as by way of theInternet. The modem 1318, which can be internal or external and a wiredor wireless device, is connected to the system bus 1301 through theinput device interface 1310. In a networked environment, program modulesdepicted relative to the computer, or portions thereof, can be stored inthe remote memory/storage device 1328. It will be appreciated that thenetwork connections shown are exemplary and other means of establishinga communications link between the computers can be used.

According to some example embodiments, the computing device 1300 can beoperable to communicate with any wireless devices or entitiesoperatively disposed in wireless communication, e.g., a printer,scanner, desktop and/or portable computer, portable data assistant,communications satellite, any piece of equipment or location associatedwith a wirelessly detectable tag (e.g., a kiosk, news stand, restroom),and telephone. This can further comprise at least Wi-Fi and Bluetooth™wireless technologies. Thus, the communication can be a predefinedstructure as with a conventional network or simply an ad hoccommunication between at least two devices.

In accordance with some example embodiments, Wi-Fi, or WirelessFidelity, allows connection to the Internet from a couch at home, a bedin a hotel room, or a conference room at work, without wires. To thisend, Wi-Fi referred herein, is a wireless technology similar to thatused in a cell phone that enables such devices, e.g., computers, to sendand receive data indoors and out; anywhere within the range of a basestation. Wi-Fi networks use radio technologies called IEEE802.11 (a, b,g, n, etc.) to provide secure, reliable, fast wireless connectivity.Further, in accordance with some example embodiments described herein, aWi-Fi network can be used to connect computers or the plurality ofelectronic devices to each other, to the Internet, and to wired networks(which use IEEE802.3 or Ethernet). Wi-Fi networks operate in theunlicensed 2.4 and 5 GHz radio bands, at an 11 Mbps (802.11b) or 54 Mbps(802.11a) data rate, for example, or with products that contain bothbands (dual band), so the networks can provide real-world performancesimilar to the basic “9BaseT” wired Ethernet networks used in manyoffices.

As used in this application, the terms “system,” “component,”“interface,” and the like are generally intended to refer to acomputer-related entity or an entity related to an operational machinewith one or more specific functionalities. The entities disclosed hereincan be either hardware, a combination of hardware and software,software, or software in execution. For example, a component may be, butis not limited to being, a process running on a processor, a processor,an object, an executable, a thread of execution, a program, and/or acomputer. By way of illustration, both an application running on aserver and the server can be a component. One or more components mayreside within a process and/or thread of execution and a component maybe localized on one computer and/or distributed between two or morecomputers. These components also can execute from various computerreadable storage media having various data structures stored thereon.The components may communicate via local and/or remote processes such asin accordance with a signal having one or more data packets (e.g., datafrom one component interacting with another component in a local system,distributed system, and/or across a network such as the Internet withother systems via the signal). As another example, a component can be anapparatus with specific functionality provided by mechanical partsoperated by electric or electronic circuitry that is operated bysoftware or firmware application(s) executed by a processor, wherein theprocessor can be internal or external to the apparatus and executes atleast a part of the software or firmware application. As yet anotherexample, a component can be an apparatus that provides specificfunctionality through electronic components without mechanical parts,the electronic components can comprise a processor therein to executesoftware or firmware that confers at least in part the functionality ofthe electronic components. An interface can comprise input/output (I/O)components as well as associated processor, application, and/or APIcomponents.

Furthermore, the disclosed subject matter may be implemented as amethod, apparatus, or article of manufacture using standard programmingand/or engineering techniques to produce software, firmware, hardware,or any combination thereof to control a computer to implement thedisclosed subject matter. The term “article of manufacture” as usedherein is intended to encompass a computer program accessible from anycomputer-readable device, computer-readable carrier, orcomputer-readable media. For example, computer-readable media caninclude, but are not limited to, a magnetic storage device, e.g., harddisk; floppy disk; magnetic strip(s); an optical disk (e.g., compactdisk (CD), a digital video disc (DVD), a Blu-ray Disc™ (BD)); a smartcard; a flash memory device (e.g., card, stick, key drive); and/or avirtual device that emulates a storage device and/or any of the abovecomputer-readable media.

As it employed in the subject specification, the term “processor” canrefer to substantially any computing processing unit or devicecomprising, but not limited to comprising, single-core processors;single-processors with software multithread execution capability;multi-core processors; multi-core processors with software multithreadexecution capability; multi-core processors with hardware multithreadtechnology; parallel platforms; and parallel platforms with distributedshared memory. Additionally, a processor can refer to an integratedcircuit, an application specific integrated circuit (ASIC), a digitalsignal processor (DSP), a field programmable gate array (FPGA), aprogrammable logic controller (PLC), a complex programmable logic device(CPLD), a discrete gate or transistor logic, discrete hardwarecomponents, or any combination thereof designed to perform the functionsdescribed herein. Processors can exploit nano-scale architectures suchas, but not limited to, molecular and quantum-dot based transistors,switches and gates, in order to optimize space usage or enhanceperformance of user equipment. A processor also can be implemented as acombination of computing processing units.

In the subject specification, terms such as “store,” “data store,” “datastorage,” “database,” “repository,” “queue”, and substantially any otherinformation storage component relevant to operation and functionality ofa component, refer to “memory components,” or entities embodied in a“memory” or components comprising the memory. It will be appreciatedthat the memory components described herein can be either volatilememory or nonvolatile memory or can comprise both volatile andnonvolatile memory. In addition, memory components or memory elementscan be removable or stationary. Moreover, memory can be internal orexternal to a device or component, or removable or stationary. Memorycan comprise various types of media that are readable by a computer,such as hard-disc drives, zip drives, magnetic cassettes, flash memorycards or other types of memory cards, cartridges, or the like.

By way of illustration, and not limitation, nonvolatile memory cancomprise read only memory (ROM), programmable ROM (PROM), electricallyprogrammable ROM (EPROM), electrically erasable ROM (EEPROM), or flashmemory. Volatile memory can comprise random access memory (RAM), whichacts as external cache memory. By way of illustration and notlimitation, RAM is available in many forms such as synchronous RAM(SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rateSDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), Synchlink DRAM (SLDRAM), anddirect Rambus RAM (DRRAM). Additionally, the disclosed memory componentsof systems or methods herein are intended to comprise, without beinglimited to comprising, these and any other suitable types of memory.

In particular and in regard to the various functions performed by theabove described components, devices, circuits, systems and the like, theterms (including a reference to a “means”) used to describe suchcomponents are intended to correspond, unless otherwise indicated, toany component which performs the specified function of the describedcomponent (e.g., a functional equivalent), even though not structurallyequivalent to the disclosed structure, which performs the function inthe herein illustrated example aspects of the embodiments. In thisregard, it will also be recognized that the embodiments comprise asystem as well as a computer-readable medium having computer-executableinstructions for performing the acts and/or events of the variousmethods.

Computing devices typically comprise a variety of media, which cancomprise computer-readable storage media and/or communications media,which two terms are used herein differently from one another as follows.Computer-readable storage media can be any available storage media thatcan be accessed by the computer and comprises both volatile andnonvolatile media, removable and non-removable media. By way of example,and not limitation, computer-readable storage media can be implementedin connection with any method or technology for storage of informationsuch as computer-readable instructions, program modules, structureddata, or unstructured data. Computer-readable storage media cancomprise, but are not limited to, RAM, ROM, EEPROM, flash memory orother memory technology, CD ROM, digital versatile disk (DVD) or otheroptical disk storage, magnetic cassettes, magnetic tape, magnetic diskstorage or other magnetic storage devices, or other tangible and/ornon-transitory media which can be used to store desired information.Computer-readable storage media can be accessed by one or more local orremote computing devices, e.g., via access requests, queries or otherdata retrieval protocols, for a variety of operations with respect tothe information stored by the medium.

On the other hand, communications media typically embodycomputer-readable instructions, data structures, program modules orother structured or unstructured data in a data signal such as amodulated data signal, e.g., a carrier wave or other transportmechanism, and comprises any information delivery or transport media.The term “modulated data signal” or signals refers to a signal that hasone or more of its characteristics set or changed in such a manner as toencode information in one or more signals. By way of example, and notlimitation, communications media comprise wired media, such as a wirednetwork or direct-wired connection, and wireless media such as acoustic,RF, infrared and other wireless media

Further, terms like “user equipment,” “user device,” “mobile device,”“mobile,” station,” “access terminal,” “terminal,” “handset,” andsimilar terminology, generally refer to a wireless device utilized by asubscriber or user of a wireless communication network or service toreceive or convey data, control, voice, video, sound, gaming, orsubstantially any data-stream or signaling-stream. The foregoing termsare utilized interchangeably in the subject specification and relateddrawings. Likewise, the terms “access point,” “node B,” “base station,”“evolved Node B,” “cell,” “cell site,” and the like, can be utilizedinterchangeably in the subject application, and refer to a wirelessnetwork component or appliance that serves and receives data, control,voice, video, sound, gaming, or substantially any data-stream orsignaling-stream from a set of subscriber stations. Data and signalingstreams can be packetized or frame-based flows. It is noted that in thesubject specification and drawings, context or explicit distinctionprovides differentiation with respect to access points or base stationsthat serve and receive data from a mobile device in an outdoorenvironment, and access points or base stations that operate in aconfined, primarily indoor environment overlaid in an outdoor coveragearea. Data and signaling streams can be packetized or frame-based flows.

Furthermore, the terms “user,” “subscriber,” “customer,” “consumer,” andthe like are employed interchangeably throughout the subjectspecification, unless context warrants particular distinction(s) amongthe terms. It should be appreciated that such terms can refer to humanentities, associated devices, or automated components supported throughartificial intelligence (e.g., a capacity to make inference based oncomplex mathematical formalisms) which can provide simulated vision,sound recognition and so forth. In addition, the terms “wirelessnetwork” and “network” are used interchangeable in the subjectapplication, when context wherein the term is utilized warrantsdistinction for clarity purposes such distinction is made explicit.

Moreover, the word “exemplary” is used herein to mean serving as anexample, instance, or illustration. Any aspect or design describedherein as “exemplary” is not necessarily to be construed as preferred oradvantageous over other aspects or designs. Rather, use of the wordexemplary is intended to present concepts in a concrete fashion. As usedin this application, the term “or” is intended to mean an inclusive “or”rather than an exclusive “or”. That is, unless specified otherwise, orclear from context, “X employs A or B” is intended to mean any of thenatural inclusive permutations. That is, if X employs A; X employs B; orX employs both A and B, then “X employs A or B” is satisfied under anyof the foregoing instances. In addition, the articles “a” and “an” asused in this application and the appended claims should generally beconstrued to mean “one or more” unless specified otherwise or clear fromcontext to be directed to a singular form.

In addition, while a particular feature may have been disclosed withrespect to only one of several implementations, such feature may becombined with one or more other features of the other implementations asmay be desired and advantageous for any given or particular application.Furthermore, to the extent that the terms “includes” and “including” andvariants thereof are used in either the detailed description or theclaims, these terms are intended to be inclusive in a manner similar tothe term “comprising.”

The above descriptions of various embodiments of the subject disclosureand corresponding figures and what is described in the Abstract, aredescribed herein for illustrative purposes, and are not intended to beexhaustive or to limit the disclosed embodiments to the precise formsdisclosed. It is to be understood that one of ordinary skill in the artmay recognize that other embodiments having modifications, permutations,combinations, and additions can be implemented for performing the same,similar, alternative, or substitute functions of the disclosed subjectmatter, and are therefore considered within the scope of thisdisclosure. Therefore, the disclosed subject matter should not belimited to any single embodiment described herein, but rather should beconstrued in breadth and scope in accordance with the claims below.

It may be noted that, as used in this specification and the appendedclaims, the singular forms “a,” “an” and “the” comprise plural referentsunless the content clearly dictates otherwise.

References within the specification to “one embodiment,” “anembodiment,” “embodiments”, or “one or more embodiments” are intended toindicate that a particular feature, structure, or characteristicdescribed in connection with the embodiment is comprised in at least oneembodiment of the present disclosure. The appearance of such phrases invarious places within the specification are not necessarily allreferring to the same embodiment, nor are separate or alternativeembodiments mutually exclusive of other embodiments. Further, variousfeatures are described which may be exhibited by some embodiments andnot by others.

It should be noted that, when employed in the present disclosure, theterms “comprises,” “comprising,” and other derivatives from the rootterm “comprise” are intended to be open-ended terms that specify thepresence of any stated features, elements, integers, steps, orcomponents, and are not intended to preclude the presence or addition ofone or more other features, elements, integers, steps, components, orgroups thereof.

Detailed embodiments are disclosed herein; however, it is to beunderstood that the disclosed embodiments are merely exemplary, whichmay be embodied in various forms. Therefore, specific structural andfunctional details disclosed herein are not to be interpreted aslimiting, but merely as a basis for the claims.

While it is apparent that the illustrative embodiments described hereindisclosed fulfill the objectives stated above, it will be appreciatedthat numerous modifications and other embodiments may be devised by oneof ordinary skill in the art. Accordingly, it will be understood thatthe appended claims are intended to cover all such modifications andembodiments, which come within the spirit and scope of the presentdisclosure.

What is claimed is:
 1. A first device comprising: a memory that storescomputer executable-instructions; a processor in communication with aserver, wherein the processor is configured to execute thecomputer-executable instructions to perform operations, comprising:receive a notification indicative of a battery level of the firstdevice; pause a workflow operation executing on the first device;activate a communication module of the first device to identify a seconddevice in proximity to the first device, wherein the communicationmodule is activated based on the received notification indicative of thebattery level of the first device; terminate a connection between thefirst device and a wearable electronic device; and transfer informationfrom the first device to the second device.
 2. The first device of claim1, wherein the connection corresponds to at least one of a wirelessconnection, a wired connection, or a Bluetooth classic connection. 3.The first device of claim 1, wherein the information transferred fromthe first device to the second device facilitates the second device toresume the workflow operation, and wherein the information comprisesvoice templates, tasks related information, configuration informationand another connected device's information.
 4. The first device of claim3, wherein the first device transfers the information to the seconddevice via at least one of a Bluetooth, Near Field Communications,Bluetooth low energy (BLE) protocol or a Wi-Fi (Wireless Fidelity)network.
 5. The first device of claim 3, wherein the workflow operationis resumed on the second device, in response to the second devicereceiving information from the server, wherein the information comprisesvoice templates, tasks related information and another connecteddevice's information.
 6. The first device of claim 1, wherein thecommunication module comprises at least an NFC (Near FieldCommunication) module.
 7. The first device of claim 5, wherein theworkflow operation is resumed by restarting the workflow operation froma step where the workflow operation was paused.
 8. The first device ofclaim 6, wherein the NFC module is enabled to identify the seconddevice, in response to a button on the first device being pressed. 9.The first device of claim 1, wherein the information from the firstdevice is transferred to the second device, in response to the firstdevice being placed near to the second device.
 10. A method comprising:receiving a notification indicative of a battery level of a firstdevice; pausing, by a processor, a workflow operation executing on thefirst device; activating, by the processor, a communication module ofthe first device based on the received notification indicative of thebattery level of the first device, to identify a second device inproximity to the first device; terminating, by the processor, aconnection between the first device and a wearable electronic device;and transferring, by the processor, information from the first device tothe second device.
 11. The method of claim 10, wherein the connectioncorresponds to at least one of a wireless connection, a wiredconnection, or a Bluetooth classic connection.
 12. The method of claim10, wherein the information transferred from the processor of the firstdevice to the second device facilitates the second device to resume theworkflow operation, and wherein the information comprises voicetemplates, tasks related information, configuration information andanother connected device's information.
 13. The method of claim 12,wherein the information to the second device is transferred from thefirst device via at least one of a Bluetooth, Near Field Communications,Bluetooth low energy (BLE) protocol or a Wi-Fi (Wireless Fidelity)network.
 14. The method of claim 12, wherein the workflow operation isresumed on the second device, in response to the second device receivinginformation, wherein the information comprises voice templates, tasksrelated information and another connected device's information.
 15. Themethod of claim 14, wherein the workflow operation is resumed byrestarting the workflow operation from a step where the workflowoperation was paused.
 16. The method of claim 10, wherein theinformation from the first device is transferred to the second device,in response to the first device being placed near to the second device.